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SMOOTH MONOTONIC TONE REPRODUCTION CURVE END POINT 

ADJUSTMENT 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

5 This invention is directed toward systems and methods that adjust an image 

processing system tone reproduction curve. 

2. Description of Related Art 

An image processing system tone reproduction curve (TRC) represents what 
the image processing portion of the system should output in gray level given a 

10 particular gray level input. The tone reproduction curve is derived from combining 

the characteristics of other portions of the system. In particular, the tone reproduction 
curve is based on characteristics of the image data source, image output terminal and 
system tone reproduction curves. The resulting image processing system tone 
reproduction curve compensates for the image data source and image output terminal 

15 characteristics to arrive at the desired system output. In particular, image processing 
system tone reproduction curves are created during the product development phase 
and stored in data files on the actual device, or, for example, in the accompanying 
driver or software files. Therefore, each possible mode and each possible 
combination of image adjustment, such as contrast and brightness, has an associated 

20 image processing system tone reproduction curve stored in a data file. The data file 
corresponding to the image data source information and the image output terminal 
information was then referenced and applied by the image processing sub-system to 
the input image information. The tone reproduction curves may be created for each of 
colors, cyan (C), magenta (M) and yellow (Y). 

25 SUMMARY OF THE INVENTION 

In order to achieve a resulting image with high quahty, and without artifacts, it 
is preferable that the output of the tone reproduction curve for a color reaches 
maximum, i.e. at 100% area coverage, when the input darkness reaches maximum, 
which generally occurs at zero reflectance. However, at least one of the three colors 

30 cyan, magenta and yellow may reach 100% area coverage before the other colors, and 
thus, may achieve gray balance to a darkness considerably less than the maximum. 
Thus, in comparison with the tone reproduction curves of the other colors, the end 
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point of the at least one tone reproduction curve may not have the desired behavior at 
maximum. 

The various exemplary embodiments of the systems and methods of this 
invention allow for an adjusted system tone reproduction curve. In particular, 
5 according to these exemplary embodiments, a new, adjusted tone reproduction curve 
is determined. 

In adjusting the tone reproduction curve to adjust the end points, kinks may be 
created in the adjusted tone reproduction curve which may cause abrupt changes in the 
final system tone reproduction curve. These abrupt changes are undesirable because 

10 they could cause artifacts such as contouring in the output image. Contouring is noise 
resulting from defects such as coarse amplitude quantizing such that artificial colors 
or boundaries may develop, and slowly varying regions of images may be truncated to 
a limited number of gray levels. 

Artifacts stemming fi:om these abrupt changes are perceptible to the human 

15 eye, and thus are unacceptable for an output image. That is, if the image is output 

without adjusting for these artifacts, the output image will include the artifacts. These 
artifacts, even if only a few mils or tens of microns, are well within the visual acuity 
of the human eye. Since the human eye can sense these artifacts, the quality of the 
resulting image suffers greatly even for small artifacts. 

20 In the various exemplary embodiments of the systems and methods of this 

invention, the tone reproduction curve is smoothed to eliminate or reduce these 
artifacts. 

In accordance with the exemplary embodiments of the systems and methods of 
this invention, the tone reproduction curve is smoothed such that kinks created by the 
25 adjustment process do not cause abrupt changes in the final system tone reproduction 
curve. 

In accordance with the exemplary embodiments of the systems and methods of 
this invention, as the tone reproduction curve approaches an end point, it is modified, 
if necessary, so that the angle between a tangent to the tone reproduction curve at a 
30 point, and a hne fi*om that point to the end point is less than a threshold value. 

In accordance with various exemplary embodiments of the systems and 
methods of this invention, the end point is considered to be a comer of a box, the 
threshold value is a function of the distance fi-om the point to the nearest of the walls 



of the comer, and the threshold value goes to zero as the distance to the wall goes to 
zero. 

In accordance with the exemplary embodiments of the systems and methods of 
this invention, the tone reproduction curve is guided to the end point in a smooth and 
monotonic fashion. 

These and other features and advantages of this invention are described in or 
are apparent from the following detailed description of the preferred embodiments. 
BRIEF DESCRIPTION OF THE DRAWINGS 

The preferred embodiments of this invention will be described in detail, with 
reference to the following figures, wherein: 

Fig. 1 is a generalized block diagram showing an exemplary embodiment of an 
image processing system according to this invention; 

Fig. 2 shows one embodiment of a preferred calibration circuit according to 
this invention; 

Fig. 3 shows one exemplary plot of an initial tone reproduction curve; 

Figs. 4 and 5 show in detail one exemplary plot of a curve used in the tone 
reproduction curve adjustment operation according to this invention; and 

Fig. 6 is a flowchart outlining one exemplary embodiment of a method for 
image processing according to this invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig. 1 shows one exemplary embodiment of an image processing 
apparatus 200 incorporating tone reproduction curve determination in accordance with 
this invention. As shown in Fig. 1, an image data source 100, an input device 120 and 
an image output terminal 300 are connected to the image processing apparatus 200 
over links 110, 1 22 and 310, respectively. The image data source 1 00 can be a digital 
camera, a scanner, or a locally or remotely located computer, or any other known or 
later developed device that is capable of generating or otherwise providing electronic 
image data. Similarly, the image data source 100 can be any suitable device that 
stores and/or transmits electronic image data, such as a client or a server of a network. 

The image data source 100 can be integrated with the image processing 
apparatus 200, or the image data source 100 can be connected to the image processing 
apparatus 200 over a connection device, such as a modem, a local area network, a 
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wide area network, an intranet, the Internet, any other distributed processing network, 
or any other known or later developed connection device. 

It should also be appreciated that, while the electronic image data can be 
generated at the time of printing an image from electronic image data, the electronic 
5 image data could have been generated at any time in the past. Moreover, the 
electronic image data need not have been generated from an original physical 
document, but could have been created from scratch electronically. The image data 
source 100 is thus any known or later developed device which is capable of supplying 
electronic image data over the link 1 10 to the image processing apparatus 200. The 
1 0 link 1 1 0 can thus be any known or later developed system or device for transmitting 
the electronic image data from the image data source 100 to the image processing 
apparatus 200. 

Similarly, the image output terminal 300 can be integrated with the image 
processing apparatus 200, or the image output terminal can be connected to the image 

15 processing apparatus 200 over a connection device, such as a modem, a local area 
network, a wide area network, an intranet, the Intemet, any other distributed 
processing network, or any other known or later developed connection device. The 
image output terminal 300 is thus any known or later developed device which is 
capable of receiving electronic image data over the liiik 310 from the image 

20 processing apparatus 200. The link 3 10 can thus be any known or later developed 

system or device for transmitting the electronic image data from the image processing 
apparatus 200 to the image output terminal. 

The image processing apparatus 200 shown in Fig. 1 is connected to the image 
output terminal 300 over Unk 310. Alternatively, the image output terminal 300 may 

25 be an integral part of the image processing apparatus 200. An example of this 
alternative configuration would be a digital copier or the like. It should be 
appreciated that the image processing apparatus 200 can be any known or later 
developed type of image processing apparatus. There is no restriction on the form the 
image processing apparatus 200 can take. 

30 The input device 120 can be any known or later developed device for 

providing control information from a user to the image processing apparatus 200. 
Thus, the input device 120 can be a control panel of the image processing 
apparatus 200, or could be a control program executing on a locally or remotely 
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located general purpose computer, or the like. As with the link 110 and link 310 
described above, the link 122 can be any known or later developed device for 
transmitting control signals and data input using the input device 120 from the input 
device 120 to the image processing apparatus 200. 
5 As shown in Fig. 1 , the image processing apparatus 200 includes a 

controller 210, an input/output interface 220, a memory 230, and a calibration circuit 
240 including at least a tone reproduction curve transformation circuit, each of which 
is interconnected by a control and/or data bus 250. The links 1 10, 122 and 310 from 
the image data source 100, the input device 120 and the image output terminal, 

10 respectively, are connected to the input/output interface 220. The electronic image 
data from the image data source 100, and any control and/or data signals from the 
input device 120, are input through the input interface 220, and, under control of the 
controller 210, are stored in the memory 230 and/or provided to the controller 210. 

The memory 230 preferably has at least an alterable portion and may include a 

1 5 fixed portion. The alterable portion of the memory 230 can be implemented using 

static or dynamic RAM, a floppy disk and disk drive, a hard disk and disk drive, flash 
memory, or any other known or later developed alterable volatile or non-volatile 
memory device. If the memory includes a fixed portion, the fixed portion can be 
implemented using a ROM, a PROM, an EPROM, and EEPROM, a CD-ROM and 

20 disk drive, a DVD-ROM and disk drive, a writable optical disk and disk drive, or any 
other known or later developed fixed memory device. 

The links 110, 122 and 310 can be any known or later developed device or 
system for connection, including a direct cable connection, a connection over a wide 
area network or a local area network, a connection over an intranet, a connection over 

25 the Internet, or a connection over any other distributed processing network or system. 
In general, the links 1 10, 122 and 310 can be any known or later developed 
connection system or structure usable for connection. 

The calibration circuit 240 inputs signals from the image data source 1 00 and 
calibrates the image data using an appropriate tone reproduction curve, for example, 

30 based on the input signals and control signals from the image data source 100, the 

image output terminal 300 and the input device 120. The calibration circuit 240 then 
calibrates the image data to arrive at the desired system output, and outputs the 
calibrated image data to the image output terminal 300 over link 310. That is, based 
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on the calibration made by the calibration circuit 240, the calibration circuit 240 
controls the output of image signals to the image output terminal 300. Accordingly, 
when the output images are output to the image output terminal 300, the resulting 
image will be output on a receiving substrate or display with the eliminated or reduced 
5 image artifacts. 

In one exemplary embodiment of the systems and methods of this invention, 
based on the characteristics of the image data source 100 and the image output 
terminal 300, and upon receiving control signals via the input device 120 indicating a 
user's selection of a particular mode of processing for the image processing device, 

10 such as photo, fine halftone, text, line art, or the like, the calibration circuit 240 

references a nominal system tone reproduction curve stored in the memory 230 for the 
image data. The calibration circuit 240 then makes adjustments to this nominal tone 
reproduction curve, such as contrast or brightness. That is, the calibration circuit 240 
determines and adjusts a system tone reproduction curve to be used to output the 

15 calibrated image data to the image output terminal 300. 

While Fig. 1 shows the calibration circuit 240 and the image processing 
apparatus 200 as portions of an integrated system, the calibration circuit 240 could be 
provided as a separate device firom the image processing apparatus 200. That is, the 
calibration circuit 240 may be a separate device attachable upstream of a stand-alone 

20 image processing apparatus 200. For example, the calibration circuit 240 may be a 
separate device which interfaces with both the image data source 100 and the image 
processing apparatus 200. 

Furthermore, the calibration circuit 240 may be implemented as software on 
the image processing apparatus 200 or the image data source 100. Other 

25 configurations of the elements shown in Fig. 1 may be used without departing from 
the spirit and scope of this invention. 

Fig. 2 shows one embodiment of a preferred calibration circuit according to 
this invention. As shown in Fig. 2, the calibration circuit 240 includes a tone 
reproduction curve adjustment unit 242 and a tone reproduction curve transformation 

30 unit 244. 

The tone reproduction curve adjustment unit 242 inputs control data, such as 
the stiffiiess function, received fi*om the input device 120, and control data received 
from the image data source 100 and the image output terminal 300, such as the 
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characteristics of the image data source 100 and the image output terminal 300, and 
determines an initial tone reproduction curve. The tone reproduction curve 
adjustment unit 242 derives the initial tone reproduction curve from the gray balance. 
The tone reproduction curve adjustment unit 242, using the gray balance, and the 
5 different darkness of the various colors, adjusts the tone reproduction curve. The tone 
reproduction curve transformation unit 244 inputs the image data received from the 
image data source 100 and the adjusted tone reproduction curve from the tone 
reproduction curve adjustment unit 242 to output calibrated image data to the image 
output terminal 300. 

10 Fig. 3 shows one exemplary plot of an initial set of gray balanced tone 

reproduction curves (the solid lines). In this plot, the vertical axis is the outputted 
amount of cyan, magenta, and yellow colorant required to produce a neutral gray, and 
the horizontal axis is the darkness of the neutral gray produced. The amount of 
colorant can be measured many ways. An image output terminal may use halftone dot 

15 area to control the amount of colorant outputted, in which case the amount of colorant 
is commonly measured by the percentage of the area that is covered by the halftone 
dots. The vertical axis is therefore labeled "area coverage". The darkness can be also 
be measured many ways. A common metric is 100-L*, where L* is the CIE measure 
of lightness. For this metric, a darkness of zero corresponds to white paper, and a 

20 darkness of 100 corresponds to a region of zero reflectance. The horizontal axis is 
labeled consistent with this metric. 

Using these tone reproduction curves would give an image processing 
system with an identity response up to the darkest CMY neutral. In otherwords, for 
any darkness input to the tone reproduction curve transformation unit 244 less than 

25 this limit, the darkness of the output would be equal to the darkness input. In other 

words, using an input to the cyan, magenta and yellow curves as a darkness of 50, the 
output of these curves is a set of cyan, magenta and yellow halftone dot area coverage 
values which, when outputted, give a neutral patch with a darkness of 50. 

In determining tone reproduction curves, cyan-magenta-yellow combinations 

30 that give gray are determined, and then plotted in relation to the darkness of the gray 
patches these combinations would produce. As illustrated in Fig. 3, each resulting 
plot is a solid curve. 
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In accordance with the various exemplary embodiments of the methods and 
systems of this invention, the tone reproduction adjustment unit 242 smoothly extends 
the tone reproduction curves for cyan, magenta and yellow, selected by the tone 
reproduction curve adjustment circuit 242, to the (100, 100) comer. Since lower 
5 density neutrals are often made with cyan, magenta and yellow, it is not necessary to 
modify the cyan, magenta and yellow curves much at the low darkness end at the (0, 
0) comer. Black is normally used to make darker neutrals, and thus, smoothness is 
more important at the high darkness end at the (100, 100) comer. As shown in Fig. 3, 
the dashed Hnes are an example of a set of desirable tone reproduction curves to be 

10 obtained by the tone reproduction curve adjustment unit 242. 

In an exemplary embodiment, a spline function is apphed by the tone 
reproduction curve adjustment unit 242 to extrapolate additional points to extend the 
sohd curves shown in Fig. 3 until they reach the "walls" of the bounding box of the 
graph. As shown in Fig. 3, for example, to smoothly extend the tone reproduction 

15 curve for cyan, which does not reach the darkness = 100 point, a spline function is 
used to provide the points missing to this point. A spline function is a smooth 
polynomial interpolation and extrapolation function well known to those skilled in the 
art. 

Figs. 4 and 5 shows in detail one exemplary plot of a curve used in the tone 
20 reproduction curve adjustment operation according to this invention. Darkness values 
are determined for area coverage values from 0% to 100% at 1% increments. As 
shown in Fig. 4, for each point in the curve received from the tone reproduction cxirve 
adjustment unit 242, the tone reproduction curve adjustment unit 242 determines an 
angle, a, between the tangent to the curve at the point, and a line drawn from that 
25 point to the end point at the (1 00, 1 00) comer. The tangent is determined from the 

position of the point of interest, and the adjacent point in the curve that is further from 
the end point at the (100, 100) comer. For each point, the tone reproduction 
adjustment unit 242 compares the angle a to the threshold angle T, which is a 
function of the distance from the point of interest to the nearest wall of the comer. As 
30 shown in Fig. 4, this distance is co. This threshold function, T(co), is determined based 
on the control signals input from the input device 120 indicating a user's selection. 
When T(co) > a, the tone reproduction adjustment unit 242 does not modify 
the point. When T(co) < a, however, the tone reproduction adjustment unit 244 moves 
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the point to reduce a to T(co). T normally goes to zero as co goes to zero, thus, as is 
preferred, the curve is directed to the (100, 100) comer as it approaches either wall. 
The region of co where T remains small therefore determines the extent of the end 
point correction region. Where T is large, the curve is not modified. T((i>) can 
5 therefore also be thought of as the curve flexibility function. 

As shown in Fig. 5, the tone reproduction adjustment unit 242 modifies the 
location of the point when T( co) < a. In Fig, 5, the unmodified points are solid, and 
the modified ones are shaded. The point of interest is moved parallel to the closer 
wall until a = T(co). The remaining improcessed points in the curve, that is, the points 

10 between the point of interest and the (100, 100) comer, are moved proportionately to 
avoid kinks. In Fig. 5, a2 represents the point's new distance to the further wall, 
while ctI represents the point's old distance to the further wall. As shown in Fig, 5, 
the tone reproduction adjustment unit 242 moves the points so that the ratio between 
the points' new and old distance to the furthest wall of the comer (a2/al) is the same 

15 as the corresponding ratio for the point of interest. 

The tone reproduction adjustment unit 242 repeats the entire analysis for each 
subsequent point. The analysis begins with the furthest point from the (100, 100) 
comer, where T(co) is generally set to 360 degrees, so that no curve modification takes 
place, and progresses towards the (100, 100) comer point by point. 

20 The exemplary embodiments of the systems and methods of this inventions 

provide adjusted tone reproduction curves that are smooth, monotonic, and reasonably 
well behaved. 

Though Figs. 4 and 5 show that the (100, 100) comer is used, it should be 
appreciated that other exemplary embodiments of the systems and methods of this 

25 invention are directed to an operation that can be used by adjusting the end points of a 
curve in any of the comers of the curve's bounding box. It should be appreciated that 
systems and methods of this invention need not be applied to all the points on the 
curve, and that application of points far from the comer may be omitted. 

Once the adjusted tone reproduction curve is determined by the tone 

30 reproduction curve adjustment unit 242, and the tone reproduction curve is smoothed 
such that the comers created by the adjustment process do not cause abmpt chaages in 
the final system tone reproduction curve, the tone reproduction curve transformation 
unit calibrates the image data based on the adjusted tone reproduction curve. 
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specifically, the calibration circuit 240 uses the smoothed tone reproduction curve to 
manipulate the image data received from the image data source 100, The calibrated 
image can then be output to the image output terminal 300. 

An exemplary embodiment of the image adjustment of the systems and 
5 methods of this invention is outlined in detail belov^ v^ith respect to Fig. 6. 

Fig. 6 is a flowchart outlining an image processing method according to this 
invention. Beginning at step SI 000, control continues to step SI 100, where image 
data source characteristics and image output terminal characteristics are received. 
Control then continues to step SlSOOThen, in step SI 200, a tone reproduction curve is 
10 determined based on the received image data source characteristics and image output 
terminal characteristics. Next, in step SI 300, the tone reproduction curve is 
smoothed. That is, as the tone reproduction curve approaches an end point, it is 
modified, if necessary, so that the angle between a tangent to the tone reproduction 
curve at a point, and a line from that point to the end point is less than a threshold 
15 value. The end point is considered to be a comer of a box, the threshold value is a 

function of the distance from the point to the nearest of the walls of the comer, and the 
threshold value goes to zero as the distance to the wall goes to zero. Control then 
continues to step SI 400. 

In step SHOO, the input image information is received. Then, in step SI 500, 
20 the image data is adjusted using the smoothed tone reproduction curve. Next, in step 
S1600, the adjusted image data is output to the image output terminal where the image 
is output. Control then continues to step SI 700 where the control sequence ends. 

The image processing apparatus 200 shown in Fig. 1 is preferably implemented 
on a programmed general purpose computer. However, the image processing apparatus 
25 200 shovm in Fig. 1 can also be implemented on a special purpose computer, a 
programmed microprocessor or microcontroller and peripheral integrated circuit 
elements, an ASIC or other integrated circuit, a digital signal processor, a hardwired 
electronic or logic circuit such as a discrete element circuit, a programmable logic 
device such as a PLD, PLA, FPGA or PAL, or the like. In general, any device, capable 
30 of implementing a finite state machine that is in turn capable of implementing the 

flowcharts shown in Fig. 6, can be used to implement the image processing apparatus 
200. 
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In particular, it should be understood that each of the circuits shown in Fig. 1 
can be implemented as portions of a suitably programmed general purpose computer. 
Alternatively, each of the circuits shown in Fig. 1 can be implemented as physically 
distinct hardware circuits within an ASIC, or using a FPGA, a PDL, a PLA or a PAL, 
5 or using discrete logic elements or discrete circuit elements. The particular form each 
of the circuits shown in Fig. 1 will take is a design choice and will be obvious and 
predicable to those skilled in the art. 

The memory 230 is preferably implemented using static or dynamic RAM. 
However, the memory 230 can also be implemented using a floppy disk and disk drive, 
10 a writable optical disk and disk drive, a hard drive, flash memory or any other known or 
later developed alterable volatile or non- volatile memory device or system. 

While this invention has been described in conjunction with the exemplary 
embodiments outlined above, it is evident that many alternatives, modifications and 
variations will be apparent to those skilled in the art. Accordingly, the exemplary 
15 embodiments of the invention, as set forth above, are intended to be illustrative, not 
limiting. Various changes may be made without departing from the spirit and scope 
of the invention. 



